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Abstract — Consider a stationary agent A at an unknown 
location and a mobile agent B that must move to the vicinity 
of and then circumnavigate A at a prescribed distance from 
A. In doing so, B can only measure its distance from A, and 
knows its own position in some reference frame. This paper 
considers this problem, which has applications to surveillance 
or maintaining an orbit. In many of these applications it is 
difficult for B to directly sense the location of A, e.g. when 
all that B can sense is the intensity of a signal emitted by 
A. This intensity does, however provide a measure of the 
distance. We propose a nonlinear periodic continuous time 
control law that achieves the objective. Fundamentally, B must 
exploit its motion to estimate the location of A, and use 
its best instantaneous estimate of where A resides, to move 
itself to achieve the ultimate circumnavigation objective. The 
control law we propose marries these dual goals and is globally 
exponentially convergent. We show through simulations that it 
also permits B to approximately achieve this objective when A 
experiences slow, persistent and potentially nontrivial drift. 

I. Introduction 

In surveillance missions the main objective is to obtain 
information about the target of interest by monitoring it for 
a period of time. In most cases it is desirable to monitor 
the target by circumnavigating it from a prescribed distance. 
In recent years this problem has been addressed in the 
context of autonomous agents, where an agent or a group of 
agents accomplish the surveillance task. This problem has 
been extensively studied for the case where the position of 
the target is known and the agent(s) can measure specific 
information about the source, such as distance, power, angle 
of arrival, time difference of arrival, etc. See [1], [2], [3] and 
references therein. However, in many situations, knowing the 
position of the target is not practical, e.g. if one wants to 
find and monitor an unknown source of an electromagnetic 
signal. This paper addresses the problem where the position 
of the source is unknown, only one agent is involved, and 
the only information continuously available to the agent is 
its own position and its distance (not relative position) from 
the source. 

There are other recent papers that consider a problem 
related to the one addressed in this paper For instance [4] and 
[5] using concepts from switched adaptive control, consider 

This work is supported by NICTA, wliicli is funded by the Australian 
Government as represented by the Department of Broadband, Commu- 
nications and the Digital Economy and the Australian Research Council 
through the ICT Centre of Excellence program, and by US NSF grants 
ECS-0622017, CCF-072902, and CCF-0830747. 

Iman Shames, Brian. D. O. Anderson, and Bari§ Fidan 
are with Australian National University and National ICT 
Australia. Soura Dasgupta is with Department of Electrical and 
Computer Engineering, University of Iowa, {iman . Shames , 
Brian . Anderson, Bar is . Fidan} @anu .edu.au, 
Da suptaS engineering . uiowa . edu. 



the case where an agent must move itself to a point at a 
pre-set distance from three sources with unknown position 
in the plane using distance measurements. Another related 
paper is [6], where the agent's objective is to estimate the 
position of the source using distance measurements only. 

The problem addressed in this paper can be studied as a 
dual control problem as well. In a dual control problem the 
aim is identify the unknown parameters of the system and 
achieve a control objective simultaneously [7]. In this case 
the mobile agent must estimate the location of the target from 
the distance measurements, and use this estimate to execute 
its control law for achieving its objective of circumnavigating 
the target from a prescribed distance. 

To estimate the target location the agent must move in 
a trajectory that is not confined to a straight line in two 
dimensions and to a plane in three dimensions. To perform 
robust estimation this avoidance of collinear/coplanar motion 
must be persistent in a sense described in [6]. A key feature 
of the circumnavigation objective is that it ensures this 
requirement thus aiding the estimation task. 

The structure of the paper is as follows. In the next 
section the problem is formally defined, and in Sectionlllllthe 
proposed algorithm is introduced. The analysis of the control 
laws is presented in Section |IV] In Section [V] the persistent 
excitation condition on the signals is established, and The 
proof of exponential stability of the system is provided. In 
Section |VT] a method to choose one of the parameters in 
the control laws is presented. The simulation results are 
presented in Section IVlIl In the final section future directions 
and concluding remarks are presented. 

II. Problem Statement 

In what follows we formally define the problem addressed 
in this paper and introduce relevant assumptions. 

Problem 2.1: Consider a source at an unknown constant 
position X and an agent at y{t) in W (n G {2, 3}) at time 
t G [0,oo]. Knowing y{t), a desired distance d, and the 
measurement 

D{t) = \\y{t) - x\\ (ILl) 

find a control law that ensures that asymptotically, y{t) 

moves on a trajectory at a distance d from x. 

Here as in the rest of the paper ||.|| denotes 2-norm. For 

convenience in the rest of the paper, we impose the following 

constraint: 

Constraint 2.1: The agent trajectory y{t) : M i-^ E", is to 
be twice differentiable. Further, there exists Mq > 0, such 
that Vt e M : \\y{t)\\ + \\y{t)\\ + \\y{t)\\ < Mq. 



This constraint ensures that the motion of the agent can be 
executed with finite force. One can break down the problem 
into the following two sub-problems: 

1) How one can estimate .t? 

2) How one can make the agent move on a trajectory at 
a distance d from x, which, in a sense to be made 
precise in the sequel, persistently spans M"? 

The first sub-problem is addressed in [6]. However, for the 
algorithm of [6] to work one requires that Vt G M, 

pt+Ti 

ail < J y{T)y{TY dT < ^2/ 

for some ai,a2, and Ti which are strictly positive. This 
condition is the well-known persistent excitation (p.e.) condi- 
tion. This condition requires that the agent in n-dimensional 
space must persistently avoid a trajectory that is confined to 
the vicinity of a single (n — 1) -dimensional hyperplane. As 
noted earlier, the circumnavigation objective in fact assists 
in maintaining p.e. 

III. Proposed Algorithm 

We first present an algorithm for estimating x. To this end 
for a > generate 

77(t) = = ~azi[t) + \D''{t), (III.l) 

m{t) = Z2{t) = -az2(i) + ]^y^{t)y{t), (111.2) 
Vit)^Z3it)^~az3it)+yit), (111.3) 

where zi(0), and 2:2(0) = are arbitrary scalars, and 23(0) 
is an arbitrary vector Note that the generation of rj{t), m{t) 
and V{t) requires simply the measurements D{t) and the 
knowledge of the localizing agent's own position, and can 
be performed without explicit differentiation. 
Define now the estimator: 



i{t) = -jV^-nit) - m{t) + V^{t)x{t)), 



(111.4) 



where x{t) denotes the estimate of x at time t, and 7 > 
is the adaptive gain. This estimator is in fact identical to the 
one presented in [6] . Later, we shall show that under suitable 
conditions x approaches x. 
Define 

b{t) = \\y{t)-x{t)\l (111.5) 
and the control law 

il{t) = i{t)-[{b''{t) - d^)I - A{t)\ {y{t)~x{t)). (ni.6) 

where A{-) : M M"^" obeys four conditions captured in 
the assumption below. As will be proved in the next section, 
this control law aims at moving the agent so that D converges 
to d, i.e. the agent takes up the correct distance from the 
estimated of the source position, x. If also x converges to x, 
then D converges to D, hence D converges to d. 
Assumption 3.1: (i) There exists a T > such that for 
all t, 

A{t + T) ^ A{t). (III.7) 



(ii) A{t) is skew symmetric for all t. 

(iii) A{t) is differentiable everywhere. 

(iv) the derivative of the solution of the differential equation 
below is persistently spanning. 



y*it)^Ait)y*it). 



(III.8) 



for any arbitrary nonzero value of y* (0). More precisely, 
there exists a Ti > 0, and > such that for all i > 
there holds 

rt+Ti 

ai\\y*{t)ri< J y*{r)r{rVdT<a2\\y*m'l. 

* (III.9) 
A consequence of the fact that A{t) is skew symmetric is 
that for all z/ G M" and t > 



v^A{t)v = 0. 



(III. 10) 



We note that the results below hold even if A{t) were permit- 
ted to lose differentiability at a countable number of points. 
However, that would imply that y would lose differentiability 
at these same points, resulting in the physically unappealing 
need for an impulsive force to act on y{t). 

As will be shown in Section [VTl in two dimensions, with 
E the rotation matrix. 



1 

-1 



(III.l 1) 



and a any real scalar, it suffices to chose A{t) as the constant 
matrix aE. In three dimensions however, the selection of 
A{t) is more complicated. Specifically for ( IIII.9I ) to hold 
with a constant A, A must be nonsingular No 3x3 skew 
symmetric matrix is however nonsingular, leading to the need 
for a periodic A{t), whose selection is described in Section 
IVII To summarize, the overall system is described by ( III. II ) 
- ( IIII.6b . with Zi, X, and y, serving as the underlying state 
variables. 

IV. Analysis 

We shall begin by establishing that the quantities rj{t) and 
in{t), computable from the measurements as described in the 
previous section, can be used to estimate V{t)^x. Of course, 
our ultimate goal is to estimate x. This will be achieved, but 
is harder 

Observe from ( llll.lb that ?/(<) ~ zi{t). Thus, one obtains 
(recalUng that x is constant): 



Similarly, 



7?(t) = -arjit) + m'^ivit) - •^)- (IV. 1) 

m{t) = -am{t) + y(<)^y(i); (IV.2) 
Vit) = -aV{t) + m- (IV.3) 



— [-nit) - m{t) + V^{t)x] = ~a [r^{t) - m{t) + {t) 



x\ , 
(IV.4) 



which implies the following Lemma. 

Lemma 4.1: For all ™d t > to, there holds: 

rj{t)-m{t)+V^ {t)x = [7/(to) - m(to) + {to)x] e-«(*-*«). 

(IV.5) 



As foreshadowed in the last section, we now present a lemma 
that shows that the agent located at y{t) moves to a trajectory 
maintaining a constant distance d from the estimated position 
of the agent at position x. 

Lemma 4.2: Consider ( IIII.6I 1 under Assumption 13.11 Sup- 
pose there exists a 5 > such that in ( IIII.5I ) 1)^(0) > 5. 
Then D'^{t) converges exponentially to d^, and there holds 
for alH > 

D^{t)>mm{S,d'^} (IV.6) 
Proof: Because of dlll.lOb one obtains that. 



Proof: First observe that on Sj, D — D — d. Thus on 



dt 



[D'{t)-d'} = 2{y{t)~Ht)V{y{t)-m) 



= -2{D^{t)-d^)D'^{t). (IV.7) 



Observe that D is bounded and continuous. Consider first 
the case where 6 > d^ . Then the derivative above is initially 
negative, i.e. D^{t) declines in value. By its continuity for 
D^{t) to become less d^, at some point it must equal d^, 
when D{t) will stop changing. Since throughout this time 
D^{t) > d^, convergence of D^{t) to d^ occurs at an 
exponential rate and D^{t) > <P for all t. On the other 
hand if ^ < d^, then D^{t) > S for all t, as the derivative 
of D^{t) is nonnegative. Again exponential convergence of 
D^{t) to d"^ occurs. ■ 

Now define x{t) — x{t) — x. We have the following Lemma, 
which is the first of two aimed at establishing a Lyapunov 
function with certain properties for the overall system. 

Lemma 4.3: Consider the system defined in dll.ll i - ( IIII.6I ). 
subject to the requirement that D(0) > and Assumption 
im Define; 



^ (77(t) - mit) + V^it)x)^ + 



1 



i=l 



where Li{t) = (zl(0)e-"*)^ 



L2{t) = (22(0)6- 



(IV.8) 



and 



Then, whenever L{t) is bounded 
so also are the state variables x{t), y{t), Zi{t), rj{t), m{t), 
and V(t). 

Proof: The second and third terms on the right hand 
side (IIV.8I 1 ensure the boundedness of x{t), y{t) and D{t). 
Thus as Li{t) are bounded dlll.lb . ( IIII.2l i and (IIII.3b ensure 
that the Zi{t) are bounded as well. ■ 



We now define, for A > the set 



^(A) = {[i^,2/^,zi,Z2,Z3']'|L<A}. 



TiTi 



(IV.9) 



Because of Lemma |431 the set 5(A) is compact. 

Next we identify an invariant set for dll.ll ) - dIII.4l ). 

Lemma 4.4: Consider the system defined in dll.lb - dIII.6l ). 
Define the set Sj as the set of vectors [x^ , y^ , zi, Z2, zj]^ 
satisfying, x ~ x, \\y — x\\ = d, and zi — Z2 + zjx = 
Then [xT(0), 2/^(0), zi(0), 22(0), 4(0)]^ £ Si impHes 
[x'^{t),y'^{t),zi{t),Z2{t),zJ{t)]'^ eSi forall i >0. 



Si, 



D"^ - y^y + 2y^5- ^ d"^ - y^y + 2x^ y = x^ x. 

Further, from dnLTT l. (IllOl i and (HlOl l on Si 

zi{i) - hit) + zj{t)x{t) = -a {zi{t) - Z2(t) + zj{t)x{t)) 

D^{t)-y^{t)y{t) + 2y^{t)x{t) 
2 

= -a{zi{t) ~ Z2{t) + zj {t)x) 
x^x 



Consequently, on Si; Zi{t) — 22 (i) + zj{t)x{t) = 0, i.e. 
zi{t) - Z2{t) + zj{t)x = 0. Then, 

i-j{t) - ra{t) + V'^{t)x{t) = zi{t) - 22 (t) + zl{t)x{t) ^ 0, 

and so x{t) = from dIII.4b . Last because of (IIV.7b . and the 
fact that b = d,^& have that b{t) = 0. ■ 

Then we have the following theorem whose proof is given 
in Appendix lAl 

Theorem 4.1: Consider the system defined in dll.lb - 
dm. 6b and Si defined in Lemma 14.41 Then for arbitrary 
initial conditions, subject to the requirement that Z3(0) > 
and Assumption 13.11 \\x^ {t) , y^ {t) , zi{t) , Z2{t) , zJ {t)\\ is 
bounded Vt > 0, and there holds: 

lim uiin\\z-[x^{t),y'^{t),z^{t),Z2{t),zJ{t)]'\\ =0. 

i— ►00 z^Si 

(IV. 10) 

Further, convergence is uniform in the initial time. 

Remark 4.1: Theorem 14. II in particular implies that, x{t) 
is bounded, limt^oo i{t) = 0, limt_+oo D{t) = d, and 
limt^oo {y{t) — X — y*{t)) = 0, where y*{t) is a nonzero 
solution of dm. 8b with nonzero y*{0) that for all t obeys 
||y*(f)|| = d. The first two limits follow from the definition 
of Si. The last limit is a consequence of dIII.6b . 

V. Exponential convergence and Persistent 
Excitation 

Having shown uniform asymptotic stability in the fore- 
going, we will now demonstrate that in fact the stability 
is exponential. For this we establish a persistent spanning 
condition first on y{t), and ultimately on V{t). This will be 
the key to establishing the exponential convergence of x to 
X, which is a strengthening of the result of Theorem 14.11 
First we establish certain conditions on the state transition 
matrix for A{t), i.e. on $(t,to) that obeys for all t^to. 



(V.l) 



Lemma 5.1: Consider $(t,to) defined in dV. Ib .with As- 
sumption |3T| Then for all i,to 

$^(t,to)$(i,to) =/• 
Proof: Consider (im.8b . Then for all t^, and y*{to) 

y*(i) = *(t, to)y*{to). 



Further because of dlll.lOl ). 

\\y*m 



\y*ito)\\ 



Since this holds for all y*{to), the result holds. ■ 

Next the first promised result. 

Lemma 5.2: Consider the system defined in dll.ll l - ( IIII.6I ), 
subject to the requirement that -D(O) > and Assumption 
13.11 Then there exists a T2 such that for all t>Q, 
rt+T2 



aid 



I < 



2 Jt 
Proof: See Appendix 



v{t)v{t)^ dT < 0:2! 



(V.2) 



We now show that V{t) satisfies a p.e. condition as well. 

Theorem 5.1: Consider the system defined in dll.lb - 
( IIII.6I 1, subject to the requirement that D{Q) > and 
Assumption 13.11 Then there exist > 0, Q!4 > 0, T3 > 
such that for all t > 



t+Ts 



V{T)V^{T)dT < aj. 



(V.3) 



Proof: Follows directly Lemma 15.21 and [6]. If we 
permitted A{t) to lose differentiability on a countable set 
then the marriage of [6] with techniques developed in [8] 
will provide a proof. ■ 

We are now ready to prove exponential converegence of x 
to X. Then in view of Lemma 14.21 and fact that y{t) is 
bounded, D{t) converges exponentially to d. Define p{t) = 
r]{t) - m{t) + V^{t)x, and observe from (llV.Sb that p{t) = 
-ap{t). Observe also that r/(t) - m(t) + V'^{t)x{t) = 
p{t) + {t)x{t). Thus one obtains: 

-fV{t)V^{t) 








. Pit) . 





Pit) 



(V.4) 



-iVit) 



Theorem 5.2: Consider the system defined in (III, lb - 
(IIII.6b . subject to the requirement that D{0) > and 
Assumption 13.11 Then (IV.4b is eas. 

Proof: From Theorem 15.11 (IV. 3b holds. Consequently, 
from [9], the system 

is eas. Then the triangular nature of (IV.4b establishes the 
result. ■ 

VI. Choosing A{t) 

In this section we focus on selection of A{t) to satisfy 
Assumption 13.11 Consider first n ~ 2, we show that with E 
as in dm. lib the matrix A{t) = aE obeys the requirements 
of assumption 13.11 Indeed consider the Lemma below. 

Lemma 6.1: With E as in dlll.llb . and a real scalar 
nonzero a consider 

m^aEm. (VLl) 
with ^ : M ^ M2. Denote ^ = [6.6]^- Define {3 as 

/3(to) = ^(Ci+i6)- (VI.2) 



i.e. the argument of the complex number +2^2- Then there 
holds for all i > to > 0, 

^it) = ||^(io)||[cos(a(i-to)+/3(to)),sin(a(t-io)+/3(to))]^- 

(VI.3) 

Proof: Follows from the facts that ^(to) = 
|l^(io)|l [cos(/3(io)), sin(/3(to))]^, and that the state transition 
matrix corresponding to dVI.lb is: 



aEt 



COS at 
sin at 



— sin at 
cos at 



The fact that dVI.3b satisfies (IIII.9b with y* identified with 
^, is trivial to check. It is also clear that under this selection, 
y{t) circumnavigates x with an angular speed of \a\. 

In preparation for treating the ?i = 3 case, we make the 
following observations. 

Lemma 6.2: Consider dVI.3b . Suppose for any to, all 
t e to,to + 2yST ' some ^? e R^, there exists e such that 
\d'^iit)\ < e\\9\\. Then 

e> |a||ie(<o)!lll^!l. (VI.4) 
Further with ^ [6,6]^, for all to and i e {1, 2}, 



Proof: For some real 
||6'||[sin?/', -cos-0]^. Hence, E'^e 
Thus under dVT3] l. 



= ||e(to)||. (VI.5) 

ip there holds 6 = 

\\9\\ [cosi/;, sin . 



e'^E^t) = \\^{t„)\\\\e\\cos{a{t-to)+f3{to)-i^). (VI.6) 

Therefore, on any interval [to, to + 7r/2|a|] the maximum of 
le'^il = \a9'^E^ \is\a \\\^{to)\\\\e\\. Further dyOll is a direct 
consequence of dVI.3b . ■ 

Finally we prove the following lemma. 
Lemma 6.3: Consider 



at) = af{t)Eat), 



(VI.7) 



where / : M ^ M and | /(<)| < 1 Vi. Then for all < to < 
t, mt)-ato)\\ < it-to)\a\\\zito)\\. 

Proof Under dVLTl i. for all t > to, U{t)\\ = Uito)\\. 
Thus, 



\m-ato)\\ 



f{T)aEaT)dT\\ 
< it-to)\a\mo)\\ 



To address the n = 3 case we first preclude the possibility 
that A{t) can be a constant matrix. Indeed observe that no 
skew-symmetric matrix in M''^'^ can be nonsingular, as if 
A is an eigenvalue of a skew symmetric matrix then so is 
— A. Thus for any odd n, an n x n skew symmetric matrix 
must have a zero eigenvalue. To complete the argument we 
present the following Lemma. 

Lemma 6.4: Suppose in dlll.Sb A(t) = A for all t and A 
is singular Then dIII.9b cannot hold. 



Proof: If A is singular, then e'^* has an eigenvalue at 
one. Thus there exists a j/*(0) such that for all t, y*{t) = 
e"^*y*(0) is a constant, i.e. for this y*(0), y* =0. ■ 

Thus, we must search for a periodic A{t) to meet the 
requirements of Assumption 13.11 Effectively, the A{t) we 
will choose will switch periodically between the two 3x3 
matrices 

B = 0®{bE), and (VI.8) 



C = (cE) © 



(VI.9) 



b and c being real nonzero scalars, and © denoting direct 
sum. However to ensure that the resulting matrix is differen- 
tiable, we require a differentiable transition between B and 



C. To achieve this define a nondecreasing g 
obeys: 

g(t) = yt<o 
g(t) = 1, V< > 1, and 
g{t) is twice differentiable Vt. 
An example of such a g{t) is 

i (1 - cos(7rt)) 0<t<l 



t < 
t > 1. 



M, that 

(VI. 10) 
(VI. 11) 
(VI. 12) 



(VI. 13) 



Clearly this satisfies dVLTOl ) and dVLTTI ). Further dvmb 
holds as 

lim g{t) = lim g{t) = 0. 

t — t — 'i — 

Now, for nonzero scalars b and c, we will select A{t) as 
follows. For a suitably small p > 0, define 



Ti = p, T2 



IT 



(VI. 14) 



and 



T4 = 3/9H 



\b\- 



\b\ \c\ \b\ \c\ 

(VI. 15) 

For all t, let Kxit) denote the largest integer k satisfying 
t > kT and let rrit) = t - KT{t)T. Then define A{t) as 



1-.9 



t-T2 

c 



< rT(i) < Ti 
Ti < rrit) < f2 
B T2< rrit) < % 

T3 < rrit) < 74 

T4 < Mt) < n 
c n<rT{t)<n = T 

(VI. 16) 

Observe that ( IVI.16b automatically satisfies (i-iii) of Assump- 
tion [3?T] To show that it satisfies (iv) as well, we present the 
following result from [10]. 

Lemma 6.5: Suppose on a closed interval X C R of length 
ri, a signal w : X ^ M is twice differentiable and for some 
ei and M' 

\w{t)\ < ei and \iu{t)\ < M' V tel. 



Then for some AI independent of ei, X and AI', and M" = 
max(il/', 2eif7^^) one has: 

\w{t)\ < M{M"eif'^ V i ex. 
Next, we establish the following result. 

Theorem 6.1: Consider dlll.SI ) with A{t) defined in 
(IVI.14b - (IVI.16l l. Then for every pair of nonzero b, c there 
exists a p* such that (|III.9l i holds for all < p < p* . 

Proof: See Appendix ICl ■ 



VII. Simulations 

In this case we study the behaviour of the system in four 
different scenarios in 2-dimensional space. 

In the first simulation we study the case where x = 
[0.5, 3]^, d= 2, and y(0) = [8, 5]^. The corresponding 
result is depicted in Fig. [T] A closer look at the agent 
trajectory reveals a very small radius turn near the point 
[2, 1]^. The reason for this behaviour is the following. The 
term — (P){y{t) — x{t) in ( IIII.6b is designed to force 

y{t) to move on a straight line trajectory in a manner that 
drives D to d. The second term A{t){y{t) — x{t)) forces y{t) 
to rotate around x{t). Initially the first term is dominant, and 
the agent quickly travels a long distance on an almost straight 
line. By the time the agent reaches [2, 1]-'", the rotational 
motion component becomes comparable to the straight line 
motion component; hence the effect of this change shows 
itself as a sharp turn. To make the trajectory smoother, in 
the second scenario we consider the same setting with the 
difference that instead of using y{t), we use the normalized 
signal; in other words the agent is moving with constant 
speed. We use the normalized version of ( IIII.6b . Furhermore, 

tit) = Ht) - liD'it) - d')I - Ait)] iyit) - 



m 



m/\\m\\ 




imw 
mt)\\ 



^0 
= 



As can be observed, the small radius turn is replaced by 
one of larger radius. The result is presented in Fig. |2] In the 
first two cases the desired orbit at the prescribed distance is 
achieved. In the third simulation we studied the behaviour 
of the system when the source slowly drifts on a circle, 
on a circle with angular velocity equal to 0.005. See Fig. 
|3] The agent maintain its distance from the source in a 
neighbourhood of the desired distance. Notice that the speed 
of the source is always much less than the speed of the 
agent. In the last simulation we consider the case where 
the distance measurement is noisy, and it is assumed that 
InD = InD + pit), where D is measurement and /i is a 
strict-sense stationary random process with pit) ^ A^(0, cr^), 
yt. The simulation result associated with this scenario is 
depicted in Fig. |4] As it can be observed the control law is 
still successful in moving the agent to an orbit with distance 
to the source kept close to its desired value. 




Fig. 1. Agent trajectory, agent distance from the estimate, agent distance 
from the real value, and distance between the estimate and true position of 
source. 



Fig. 4. Agent trajectory, agent distance from the estimate, agent distance 
from the real value, and distance between the estimate and true position of 
source, in the presence of noisy measurement. 
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VIII. Future Work and Concluding Remarks 

In this paper we proposed an algorithm to solve the 
problem of monitoring a source at an unknown position 
by a single agent while the only information available to 
the agent is its distance to the target. Stability of the 
system has been established. Furthermore, in simulations the 
performance of the method in the presence of noise and 
in the situations where the source is undergoing a drifting 
motion is presented. An important future work is to establish 
stability of the system when the source is undergoing a 
drifting motion. Another possible extension of the current 
scheme is to consider the cases where more than one agent 
is present. 



Fig. 2. Agent trajectory, agent distance from the estimate, agent distance 
from the real value, and distance between the estimate and true position of 
source, where agent is moving with constant speed. 
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Fig. 3. Agent trajectory, agent distance from the estimate, agent distance 
from the real value, and distance between the estimate and true position of 
source, where the source is undergoing a drift. 
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Appendix 



A. Proof of Theorem \4.1\ 

First observe that the system (III. Il l - (IIII.6I 1 is in fact 
periodic. Thus, convergence if it holds, will be uniform in 
the initial time. 

Consider L{t) and Li{t) defined in Lemma [431 Now for 
every finite initial conditions there is a A such that 

[x^(0),2/^(0),zi(0),Z2(0),4(0)]^ e 5(A). 

As shown above this set is compact. 

Note that for all i € {1,2,3}, Li{t) = -2aLi{t). 

Then because of Lemma 1121 dlini) . (IIIL6I 1 and (llY4] l. 
there holds 

- x'^(t)V{t) {r](t) ~ m{t) + V^{t)x + {t)i{t)) 
b\i)-d^) [y-^ [t) - {t)) (y{t) - m) 

i=l 

-\ {fjit) - m{t) + V^{t)x{t)f l{i^[t)V{t)f 
2 ^ 

i=l 

(A.l) 

Thus all trajectories commencing in S'(A) lie in S'(A), and 
hence {t), zi{t), Z2{t), zj {t)\\ is bounded Vi> 

0. 

To prove the theorem we simply need to show that 
convergence occurs to 5(A) H'^/. By Lasalle's theorem this 
will hold if 5(A) Pi 5/ is the largest invariant set in 5(A). 
Lemma l4~4l and (lA.lb already shows that 5(A) p| 5/ is an 
invariant set. To show that it is the largest invariant set we 
must show that 

i = 0, (A.2) 



implies that there hold for all t > 

x(t) = X, 
\\y{t)~x\\^d, 

Zl{t) - Z2{t)+zJ{t)x 



X^ X 



2a 



(A.3) 
(A.4) 

(A.5) 



Now (IA.2I 1 necessitates the pair of identities: 

i = 0, (A.6) 

b = d. (A.7) 
From ( IA.6b one obtains that for some constant x* 

x = x*. (A.8) 

Further under (IA.7b . dA.Sb and ( IA.6I ), ( IIII.6b reduces to 

y{t)=A{i){v{i)-^*)- (A.9) 



Thus, along trajectories corresponding to (IA.2b . there holds: 

y{t)^x* +y*{t), (A.IO) 



where y*{t) is a solution of ( 1111.8b . Denoting a = ??(^o) — 
™(io) + V^{to)x, because of (lllL4] i, ( TOI l. (lOl l. and 
Lemma |4T| for all t > to; one has that: 

i^{t)-m{t) + V^{t)x* 
ri{t) - m{t) + V^{t)x + V'^{t){x* - x) 
ae"''^*-'"^ +V^it)ix* -x). 







Thus one has 



dt 



V {t){x* - x) = -ae 
{V^ {t){x* ~ x)} =aae-"(*-*°). 



(A.ll) 
(A. 12) 



As {x* — x) is a constant, combining (lA.llb . ( IA.12b with 
(IIV.3b . we obtain that along trajectories corresponding to 
(lOl i, for all t > to. 



-a(t-to) 



aae — = aae + 2/^(t)(a;* - x), 

i.e. for all t > 0, y'^{t){x* - x) ^ 0. Given that (x* - x) 
is a constant and because of ( |III.9b and dA.lOb this can only 
hold if X* = X. Further in view of (IA.7b along ( IA.2b D = d. 

Thus (IAJT i and dAlT i are necessary for (I A. 2b to hold. 
Finally we observe from ( IA.2b . (IA.3b . and the first term in 
(lA.lb that: 



77 — m + V^^i = T] — m + X = 0, 

- llyf + 2yTa; 



>r) — m + V^^x = 



— a{zi ~ Z2 + z^ x) + 



0, 



— a 2i — 2:2 + ^3 X 



x^x 



2a 



= 0, as D = d, 



establishing dA.Sb . 

B. Proof of Lemma 15.21 

A consequence of assumption 13.11 is that for all unit 9 G 
M", t > and z G R", there holds: 

ai||z||2< j \e'^A{T)<i>{T,t)z\^dT. (B.l) 

Further because of dIII.6b for all ti > and t > ti there 
holds: 

yit) - i{t) = A{t)<^>{t, ti){y{h) - xih)) 

-Ait) f ^t,T){b'-ir) - d')iy{r) - xiT))dT. 

(B.2) 

Assumption 13.11 ensures that A{t) is bounded. Thus there 
exists M2 such that 

\\A{t)\\ < M2 -it. (B.3) 

Further because of Lemma 14.21 and Theorem 14.11 there is a 
7 > 0, such that for every e > 0, there is a t2 such that for 
all t > t2, 

\d-\\y{t)-x{t)\\\<e, (B.4) 



|!.T(t)||<e, (B.5) 

Thus because of Lemma ISTl (IB. 2b - ( IB.6b for every unit 9 e 
R" and t > 

e(d + e)M2 



> |0^A(t)$(t,t2)(2/(i2)"a:-(t2))|-e- 



7 



Thus there exist i^T^ all positive such that for all t >t2 there 
holds 

4 
i=l 

(B.7) 

Choose T2=Ti+t2. Then because of dRTT i and (iBTl i for 
all t > 0, there holds: 

/;+^^ \0-^y{r)\^dr 
> Sill: ry{r)\-dr 



> \9-^AirMT,t2)iyit2) - x{t2)rdr 



Then the left inequality in (IV.2b follows by choosing e so 
that 



(B.8) 



1=1 



The right inequality in ( IV.2I ) follows from the boundedness 
of i, dlira , dllOl l. ( IIlL9l l, and Lemma gl] 



C. Proof of Theorem 16.71 

We will prove the result by contradiction. First observe 
that as A{t) is differentiable and y* is bounded. Also observe 
that if (IIII.9I ) holds for || y* (0) || = 1, then it holds for arbitrary 
||y*(0)j|. Thus assume that ||y*(0)j| = 1. Consequently for 
alU > 

lly*WII = i- (C.I) 



Suppose ( |III.9b is violated. Then for all £2 > and T3 > 0, 
there exists a to and a unit norm 9 = [9i,92,93]^ G M'^, 
such that 



rir)rdr<ei 



ta 



Thus from Lemma l63] for some M^, all 62 > 0, some T4(e2), 
dependent only on the bound on y*{-) and 62, and all > 
T4(e2), there exists a to and unit norm 9 G M^, for which 



eVWl <^-^3e2^' Vt e [io,io + T3]. 



Choose 



ti = min{fcr > <o + T4{e2)\k G Z+}. 



(C.2) 



(C.3) 



Denote y* — [j/i, 2/2' 2/3]^- Observe at least one of 
II [6*1, ^'2]^!! or ||[6'2,6'3]^|| must exceed since 9 has 

unit norm. We consider two cases. 
Case I: ||[0i,02]^|| > l/VS . 



Since the inequality in iC.2i holds on the indicated inter- 
val, it must hold for all t e [h + kT + f^, h + kT + Tg], 
fc G Z. 

Thus for all t G [ti + fcT + 74, ti + kT + T5] and fc G Z, 
there holds: 



|[^ 



1,P2J 



(C.4) 



Now for all t e [h + kT + T4, h + kT + T5], there also 
holds: 



= cE 



ym 



Thus, from ( IVI.4I ) of Lemma 16.21 and the hypothesis of the 
case, we obtain that for all fc G Z, 



[ylih +kT + 74), 2/2 (ti + kT + f4)]^\\ < 



Further with some hi 

' ym ' 

2/2 W 



= hi{t)E 



T„ ^ ^/3M3 1/2 
^2 • 

(C.5) 

M, in the interval [fcr+r4, (fc + 
2/tW " 



2/2 (i) 



Thus, 



\\[ylih + {k + l)T),y*{h + ik + l)T)]'^\\ = 
\\[yl{ti + kT + T,),y*2{h+kT + f,r\\<^el/\ 



Consequently because of (IC.lb . there holds: 

II [2/2*(ti + (fc + i)r), 2/^(ti + (fc + i)r)]T|| > 

|2/S(ti + (A: + l)T)|>l-^4/^ 



(C.6) 



(C.7) 



Further throughout the interval t e [h + kT, ti + kT + T3] 
for some /12 : M R, |/i2(t)| < 1, 



h2{t)E 



2/2 W 

2/SW 

Thus from Lemma 16.31 and (IC.6b 



2/2 W 

2/3(0 



|2/;(ti + fcr + ri)| < 



Also from (IC8b and dC? 



/2 



p|6|. 



(C.8) 



(C.9) 



ll[2/2(i),2/5(Oril>l 



ViMs 1 



/2 



holds for alH G [ti + fcr, ti + fcT+fb]. Notice in the interval 
[[ti + fcT + Ti, ii + kT + T2], dOI ) holds with h2{t) = 6. 
Thus from (IVI.Sb of Lemma 16.21 



|c| <^2 

(C.IO) 



\y*2 {h +kT + t2)\ + I2/2* (ti + fcT + Ti) I 
> |2/2*(ii+T + T'2)-2/2*(^i+r + Ti)| >1 



Consequently, from ( IC.9b 

|2/5(ti + fcr + T2)| >i- 

Further, from Lemma 16.31 



2x/3A/3 1 



/2 



p|5|. 



|2/2*(ti + fcT + T4)| > 1 - ^^^4/2 _ p (2|6| + Id) 



(C.ll) 



and sufficiently small £2, dC.llI ). contradicts with dC.Sb . 
Case II: || [6*2, 6l3]^|| > l/\/3 . Follows similarly with the 
same set of p given in ( IC.12b . 



